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GOAP in Tomb Raider 


• Started in 2006 for unannounced title at the request of our 
lead designer, based on his impressions from the GOAP 
presentation at GDC 2006. 

• First shipped title using it was Tomb Raider 2013 (and now being used for the next Tomb 
Raider due in 2015). 
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GOAP in Tomb Raider 


• Started in 2006 for unannounced title at the request of our 
lead designer, based on his impressions from the GOAP 
presentation at GDC 2006. 

• First shipped title using it was Tomb Raider 2013 (and now being used for the next Tomb 
Raider due in 2015). 


Most AI development time is spent on code support for 
Goals and Actions, not the GOAP code. 


New GOAP features added as gameplay requirements 
changed... 
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Extensions to GOAP 


• Situational Costs for Actions 

• Causes a Plan with an inexpensive primary Action to 

potentially become expensive due to high situational cost of 
an Action for a requirement. 
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• Causes a Plan with an inexpensive primary Action to 

potentially become expensive due to high situational cost of 
an Action for a requirement. 
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• MeleeAttack(cost=l) + (cost=20, due to 20m of movement) = Plan Cost of 21 
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Extensions to GOAP 


• Situational Costs for Actions 

• Causes a Plan with an inexpensive primary Action to 

potentially become expensive due to high situational cost of 
an Action for a requirement. 

• For example: 

• MeleeAttack(cost=l) + (cost=20, due to 20m of movement) = Plan Cost of 21 

• RangedAttacI- (cost=10) + ;oto(cost=l, due to lm of movement) = Plan Cost of 11 

• Preferable to putting hard limits on attacks because there might be situations where 
some attacks are unavailable (e.g. out of ammo, melee weapon destroyed, etc.). 
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• Situational Costs for Actions, continued... 

• Can also be used to vary the costs of Actions depending on 
equipment or some other modifier. 

. RangedAttack(cost=5 with MachineGun, or 10 with a Bow). 

. MeleeAttack(cost=l with Dual-wielded Swords, or 5 with Fists). 
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• Situational Costs for Actions, continued... 

• Can also be used to vary the costs of Actions depending on 
equipment or some other modifier. 

. RangedAttack(cost=5 with MachineGun, or 10 with a Bow). 

. MeleeAttack(cost=l with Dual-wielded Swords, or 5 with Fists). 

• Useful for creating competing complex (multi-Action) methods of 
solving the same requirement(s). 

. Goto(cost=20, for 20m) + MeleeAtta (cost=l) = Plan Cost of 21 

. r akeOff(cost=l) + FlyTo(cost=4, for 20m) + Land(cost=l) + MeleeAttack(cost=l) = Plan Cost of 7 
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Motives to drive Goal/Action Availability and Cost 


• Very useful for an Action like UseObject that must determine which, of 
many, objects an NPC should consider using. 

• The object can "advertise" an effect that is different from the change that will happen after 
actual usage. 

• The system can be tuned to modify motives over time (e.g. Hunger always increases on its 
own), or in response to events, in addition to before/during/after Actions such as UseObject 
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• For Example, the Investigate Goal might only be available if a motive named Suspicion is 
higher than some tunable value. 
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Motives to drive Goal/Action Availability and Cost 


• Very useful for an Action like UseObject that must determine which, of 
many, objects an NPC should consider using. 

• The object can "advertise" an effect that is different from the change that will happen after 
actual usage. 

• The system can be tuned to modify motives over time (e.g. Hunger always increases on its 
own), or in response to events, in addition to before/during/after Actions such as UseObject 


• Motives can also be used to control Goals. 

• For Example, the Investigate Goal might only be available if a motive named Suspicion is 
higher than some tunable value. 


• Actions without requirements related to motives can still have an effect 
on them. 

• For example, a successful attack might reduce Fear, which is used to control the lee Goal. 
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Submitting Multiple Plan Candidates 


• Optionally, a Goal or Action, such as eObj , can submit multiple requirement 
sets (with different values, such as a different object to be used), which the Planner 
will then add to the options pool (the set of search options the A* search is working 
on) to find the best plan. 
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Submitting Multiple Plan Candidates 


• Optionally, a Goal or Action, such as eObj , can submit multiple requirement 
sets (with different values, such as a different object to be used), which the Planner 
will then add to the options pool (the set of search options the A* search is working 
on) to find the best plan. 

• For example, two or three objects might be found for the Goal that will help 

address a motive that requires attention, and so we will submit a Requirements List for 
each, which will then be evaluated as separate plans. 

• The closest object might not necessarily be the best to use, because its requirements might require a 
more complex plan. 

• Can also be used for multiple targets, to find which one can be attacked for the lowest cost, 
with an optional (tunable by Goal) plan score multiplier per requirement list to raise the plan 
score for plans whose requirements list specifies a non-preferential target. 

• Or, for a given Action, two (or more) requirement lists could be submitted (e.g. for 
AttackRanged we could submit one option to use the currently-equipped bow and another 
that requires equipping a machine gun first). 
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Situational Requirements 


• Some objects can introduce requirements that must be satisfied by the 
Planner (in addition to the requirements of the Action that allows usage of 
that object). 
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Planner (in addition to the requirements of the Action that allows usage of 
that object). 

• For example, a DinnerTable object for the Goal might have 

requirements like Food and Drink that can only be acquired by using other 
objects. 

• A plan to use DinnerTable could look something like this: GoTo(FoodServer), Use(FoodServer) to get 
Food, GoTo(Bar), Use(Bar) to get Drink, GoTo(DinnerTable), Use(DinnerTable). 


• Performing an Action might affect our inventory and/or state as well (e.g. after using the DinnerTable 
object the Food and Drink are removed, and the Hunger motive is reduced. 
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Situational Requirements 


• Some objects can introduce requirements that must be satisfied by the 
Planner (in addition to the requirements of the Action that allows usage of 
that object). 

• For example, a DinnerTable object for the Goal might have 

requirements like Food and Drink that can only be acquired by using other 
objects. 

• A plan to use DinnerTable could look something like this: GoTo(FoodServer), Use(FoodServer) to get 
Food, GoTo(Bar), Use(Bar) to get Drink, GoTo(DinnerTable), Use(DinnerTable). 

• Performing an Action might affect our inventory and/or state as well (e.g. after using the DinnerTable 
object the Food and Drink are removed, and the Fiunger motive is reduced. 

• Or, for example, the RangedAttack Action might require a certain weapon to be used, and that weapon 
object will need to be acquired by using another object that advertises that it provides that weapon 
object, resulting in a Plan containing a UseObject even though RangedAttack doesn't explicitly require it. 
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Monitoring Child Actions 


• Enables a parent Action or Goal to mark a child Action's requirement as 
completed before the child Action completes on its own. 

• For example, the Ran Action might require that the client must be within 5m of a 

target, and then monitor the status of the target to force the child Soto Action to terminate 
early (e.g. if the Action determines that the NPC has LineOfSight to the target 

within a tunable max ranged attack distance of 10m while the child Action is running). 
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Monitoring Child Actions 


• Enables a parent Action or Goal to mark a child Action's requirement as 
completed before the child Action completes on its own. 

• For example, the Ran Action might require that the client must be within 5m of a 

target, and then monitor the status of the target to force the child Soto Action to terminate 
early (e.g. if the Action determines that the NPC has LineOfSight to the target 

within a tunable max ranged attack distance of 10m while the child Action is running). 


• Also enables the parent Action or Goal to dynamically change the 
requirements while the child action is in progress. 

• For example, when the target moves it can change the required end position for the child 
Action, or tell it to move to a new CoverPoint that just became available or viable. 

• This often forces Actions to monitor their requirements dynamically to make sure they are 
still achievable (and/or requires parent Actions or Goals to make sure they don't modify 
existing requirements in such a way that completion is no longer possible). 
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Evaluating and Communicating the Plan's State 

A Goal or Action can monitor the status of the Plan while child Actions 
are still running and cause it to abort. 

• For example, a parent Action could determine the target is no longer valid (e.g. he is now 
injured or dead, or the object we intend to use is no longer available), or it is no longer the 
best target (e.g. we are now aware of a better target for this Action, so cancel the plan or 
switch targets, if applicable). 
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injured or dead, or the object we intend to use is no longer available), or it is no longer the 
best target (e.g. we are now aware of a better target for this Action, so cancel the plan or 
switch targets, if applicable). 

The Goal or Action can also use its awareness of the current state of the Plan to 
communicate with other NPCs (e.g. notify them that "I'm on my way to that 
CoverPoint to attack target X" at an appropriate time while the Plan is active). 
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Evaluating and Communicating the Plan's State 

A Goal or Action can monitor the status of the Plan while child Actions 
are still running and cause it to abort. 

• For example, a parent Action could determine the target is no longer a valid (e.g. he is now 
injured or dead, or the object we intend to use is no longer available), or it is no longer the 
best target (e.g. we are now aware of a better target for this Action, so cancel the plan or 
switch targets, if applicable). 

The Goal or Action can also use its awareness of the current state of the Plan to 
communicate with other NPCs (e.g. notify them that "I'm on my way to that 
CoverPoint to attack target X" at an appropriate time while the Plan is active). 


The Goal or Action can also use this awareness to provide feedback for the player 
(e.g. "You're in trouble now, I'm going to hit you with a grenade from that hill over 
there!"). 
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Open-Ended Actions 


Actions don't necessarily need to complete as soon as they have completed one 
iteration of the required Action. 

For example, the Action might be tuned to be allowed to take several shots, 

and even contain several tasks (such as Reload, StepOutFromCover, StepIntoCover, Aim, 
Fire, etc.) that it completes while attempting multiple shots. 
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Fire, etc.) that it completes while attempting multiple shots. 


Requires accurate maintenance of "remaining cost" for each Action so re-planning 
can still happen for the same Goal. 
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Open-Ended Actions 


Actions don't necessarily need to complete as soon as they have completed one 
iteration of the required Action. 

For example, the Action might be tuned to be allowed to take several shots, 

and even contain several tasks (such as Reload, StepOutFromCover, StepIntoCover, Aim, 
Fire, etc.) that it completes while attempting multiple shots. 


Requires accurate maintenance of "remaining cost" for each Action so re-planning 
can still happen for the same Goal. 


Prevents repeatedly constructing/starting/finishing an identical Plan for the same 
Goal, yet we can still find a different Plan with a lower total cost than the remaining 
cost of the current Plan for that Goal. 

• For example, an NPC is in a great location to shoot from can keep shooting without re- 
planning for each shot. But, if we find ourselves in a situation where we can make a new 
Plan for the Attack Goal, such as MeleeAttack, with a lower total cost than the remaining 
cost of the Plan we already have for that Goal, we are able to do it. 
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Learning/Adapting based on Success Rates 


• The GOAP system in Tomb Raider keeps track of success 
rates for Goals and Actions, and can be tuned to use that to 
influence planning. 

• For example, an Action such as might be tuned to have a variable cost 

depending on its success rate, which might result in it being used less often (only when the 
conditions allow the total cost of a Plan with to be lower than any competing 

Plan, such as one with , for a given Goal), or only when some other less- 

expensive option is unavailable (on cooldown, out of ammo, weapon broken, etc.). 
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milestones. They are tracked as part of the "GOAP Settings" (a set of Goals and Actions 
with costs and other settings) which are associated with a particular type of NPC. 
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Learning/Adapting based on Success Rates 


• The GOAP system in Tomb Raider keeps track of success 
rates for Goals and Actions, and can be tuned to use that to 
influence planning. 

• For example, an Action such as might be tuned to have a variable cost 

depending on its success rate, which might result in it being used less often (only when the 
conditions allow the total cost of a Plan with to be lower than any competing 

Plan, such as one with , for a given Goal), or only when some other less- 

expensive option is unavailable (on cooldown, out of ammo, weapon broken, etc.). 

• Statistics can be saved with the game data, or reset at tunable intervals or specific 
milestones. They are tracked as part of the "GOAP Settings" (a set of Goals and Actions 
with costs and other settings) which are associated with a particular type of NPC. 

• Requires different GOAP Settings for different NPC types (so melee-centric NPCs are 
influenced only by success rates for attacks by other melee-centric NPCs, for example). 
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Behavior Graph 


• We can use a designer-authored Behavior Graph to drive 
Goal selection, rather than a prioritized list of Goals. This 
enables designers to create tree- or DAG-like logic for 
Goal selection depending on the current status of an NPC. 
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• We can use a designer-authored Behavior Graph to drive 
Goal selection, rather than a prioritized list of Goals. This 
enables designers to create tree- or DAG-like logic for 
Goal selection depending on the current status of an NPC. 

• For example, an NPC that is in a pre-combat state might have one set of Goals 
it considers (with additional logic to cause certain Goals to be evaluated only in 
certain situations), and another set of Goals for higher alert levels, including 
highly-customized logic for Goal evaluation in combat situations. 
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Behavior Graph 


• We can use a designer-authored Behavior Graph to drive 
Goal selection, rather than a prioritized list of Goals. This 
enables designers to create tree- or DAG-like logic for 
Goal selection depending on the current status of an NPC. 

• For example, an NPC that is in a pre-combat state might have one set of Goals 
it considers (with additional logic to cause certain Goals to be evaluated only in 
certain situations), and another set of Goals for higher alert levels, including 
highly-customized logic for Goal evaluation in combat situations. 

• Designers can customize usage of certain Goals in the logic of the Behavior 
Graph without requiring additional code (e.g. Converse will only be available if 
one or more motives are above or below certain levels), or if the Player has or 
hasn't done something (ever, or recently), or if the target has a certain 
weapon equipped, or is in a certain health state, etc. 
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Example of a (simplified) Tomb Raider Behavior Graph 
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Comprehensive Debugging Support is Critical 


Designers tend to force behaviors (via scripting) when they don't 
understand why an NPC is doing something other than what they 
expected him to do. 
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Comprehensive Debugging Support is Critical 


Designers tend to force behaviors (via scripting) when they don't 
understand why an NPC is doing something other than what they 
expected him to do. 

Scripting is great for demos or extremely linear sections of the game, 
but situations without systemic behavior are fundamentally weaker and 
less interesting, and offer very little replay value. 
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Debugging Support 


Designers tend to force behaviors (via scripting) when they don't 
understand why an NPC is doing something other than what they 
expected him to do. 

Scripting is great for demos or extremely linear sections of the game, 
but situations without systemic behavior are fundamentally weaker and 
less interesting, and offer very little replay value. 

Complex plans can be confusing to observe, although complex plans 
should be the exception, not a common occurrence. This is a 
fundamental aspect of GOAP: the Planner will always choose the least 
expensive Plan for a Goal. 
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Common Question 1: What is that NPC 
doing right now? 

• Give details about the current Plan. 


• When did each Action start? 

• Why did completed Actions finish? 

• Which Action is currently active? 

• What is the status of each Action in the current Plan 
(including those that haven't started yet). 
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Common Question 2: Why isn't the NPC 
doing something else right now? 


• Why weren't other Goals and/or Actions selected when we 
created the current Plan? 

• Why haven't we been able to create a better Plan while the 
current Plan is active? 
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Common Question 3: What did he do 
before his current Plan, and why? 

• Provide details about why other Goals/Actions weren't selected 
when we created a previous Plan. 

• Provide details about the final state of a previous Plan. 
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Tomb Raider GOAP Debugging - Last Planning Attempt 



[Current Time: 22.65 


Rejected GOAP Goals/Actlons for LastPlanmngAttempt (922.44 next-0.46): 
Rest: Not Incapacitated 
Oespawn: No despawn request 


w..se Inputs (age: 0.05s): 

See laracroft.1 Last-0.2 Rec Revealed RevCnt-1 Next- 


CP Ammo-30/30 Combat-6. 7s.end-599993.4s Suppressed-4.1s 


: ON | 


1 T 

FRAME 

BY FRAME MODE 


enm_smg:74 H-30001^000 Qn£^9^ti*n^Scavf nger CP Ammo-30/30 Combat-6.7s.end-599993.4s Suppressed-4.1s 
Mover: Ori=Dir*- Aimi269]269 Wl%[d]/30tf Mlift-1.0 Slp-0.00 Pos=67. -346.0 MoverMode-lnstanceOrivesMover 
CurTarg: laracroft 1 d-596 ang-t5.h-269.v--4 xys«-S07.-188.0 health-100 0 v r HT-CurTarg* ft 

(17 96) Attack (pri-91) - Target laracroft 1 M ■ 

--(22.26) Attack. Ranged (active) - Waiting (2.5s remammg)"^^ 

_( 20.00] Goto (completed) - Entering CoverPoint (17D1E7C30) ^ # -ft 

(18.98) UseObject (completed) - Finished after 1 use(s). Reason: reached requested usage limit of 1 (or Needs satisfied) after 1 uses 

' (17.96) Goto (completed) - Finished: d-56.8. ok-0.0-64.1. goal-Pos- W ft" 

^-(17.96) PlaylnputAction (completed) M 

(17.20) Attack [pri-91] - Target: laracroftl - aborted 9 17.96.—^^— —^9— — "W 

\?[ 17.20) Attack. Ranged (aborted) - Became suppressed while aiming U I v > 

(17.20) Goto (completed) jFF 

(15.55) Investigate [pri— 94] - Ev ent: Pro jectilelmpact.Nearby (non-casual. d-107.9cm. t-laracrof t:1. s-pr. arrow. recurve:95) - aborted 9 15.99 (StateControl 
““(pending) Investigate (active) jF JF ^k 

(pending) Goto (active) Jr F M ■ ^k 

.*^[15 55) PlaylnputAction (active) ^F M W 

1(0 07) idle (pri-88) - canceled 9 <«■ «■«■ - ^ W 

“•(0.07) Idle (active)*”!**'— 


aborted the ActionPlan) 


Flee: Nothing to flee from 

l CallForHelp No recent i i| III ni| 

UseTurret: No available turrets 
. Cover.Exit: CoverPoint Valid 
UseObject.HlghPriority: Nothing to use r 
UseWaypomts.HlghPrionty: No HP Waypoints 
Attack -> Attack. Melee: Too far away: d-5.96m. n 
Attack -> Attack. Seize Disabled^ 

Attack -> Attack.Heroic: GOAP Action Oisabled 
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Tomb Raider GOAP Debugging - Details 



(35.151 Attack [pn-91] - Target: laracroft:95 
[39.28] Attack.Ranged (active) • Waiting (2.4s remaining) 


[36.99] Goto (completed) - Entering CoverPoint (17DE92C20) 
[35.98] UseObject (completed) - Finished after 1 use(s). 




Reason: reached requested usage limit of 1 (or Needs satisfied) after 1 uses 


PlaylnputAction (completed)' 


[34.38] Attack [pri-91] - Target: laracroft:95 - aborted 9 35.15^ 

—[34.38] Attack. Ranged (aborted) - Became suppressed while starting shot 
[34.38] Goto (completed) ^ 

I [31.93] Investigate [pri-94] - Event: Projectilelmpact (casual, d-304.9cm, t«laracrofr95, s 
f "[pending] Investigate (activey^” 

I .^[pending] Goto (active)^jr 
[31.93] PlaylnputAction (acti 
p[21.45] Idle [ pr i=88 ] - canceled 9 31.93 
[21.45] Idle (active)^y 




pr. arrow. recurve:3a) - aborted 9 33.48 (StateControl aborted the ActionPlan) 




Rejected GOAP Goals/Actions for LastPlanningAttempt (€>22.44 next=0.46): 
Rest: Not Incapacitated 
Despawn: No despawn request 

Flee Nothing to flee f rom 

CallForHelp: No recent enemy sigh tin 

UseTurret: No available turrets 

Cover.Exit: CoverPoint Valid 

UseObject.HighPriority: Nothing to use r 

UseWaypoints.HighPriority: No HP Waypoints 

Attack => Attack.Melee: Too far away: d=5.96m, max = 1.80 

Attack => Attack. Seize Disabled^ M 

Attack => Attack. Heroic: GOAP Action Disabled 



Rejected GOAP Goals/Actions for Previo usPlan»2 (g21.45): ^^ J ^ M 
Despawn: No despawn 
UseTurret: No enemy to fire at 
UseObject.HighPriority: Nothing to use 
WithSquad: No squad 
Investigate: Nothing to investigate 
UseWaypoints: No requested Waypoi nSety 
Follow: Nobody to follow 

Patrol: No nearby patrol waypoints.l^^^^^^^^^^^ 

Converse: Need comparison faile d: lo neliness < -1.00 (value-8.52) 
UseObject: Nothing to use 
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